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Cross Reference to Related Application 

[0001] This application claims the benefit of the filing date of U.S. 
5 application No. 60/363,563 filed 13 March 2002 and entitled HIGH 
DYNAMIC RANGE DISPLAY DEVICES. 



Technical Field 

[0002] The invention relates to displays for displaying digital images. 

10 

Background 

[0003] Dynamic range is the ratio of intensity of the highest 
luminance parts of a scene and the lowest luminance parts of a scene. For 
example, the image projected by a video projection system may have a 
1 5 maximum dynamic range of 300: 1 . 

[0004] The human visual system is capable of recognizing features in 
scenes which have very high dynamic ranges. For example, a person can 
look into the shadows of an unlit garage on a brightly sunlit day and see 
20 details of objects in the shadows even though the luminance in adjacent 
sunlit areas may be thousands of times greater than the luminance in the 
shadow parts of the scene. To create a realistic rendering of such a scene 
can require a display having a dynamic range in excess of 1000:1. The 
term "high dynamic range" means dynamic ranges of 800: 1 or more. 

25 

[0005] Modem digital imaging systems are capable of capturing and 
recording digital representations of scenes in which the dynamic range of 
the scene is preserved. Computer imaging systems are capable of 
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synthesizing images having high dynamic ranges. However, current display 
technology is not capable of rendering images in a manner which faithfully 
reproduces high dynamic ranges. 



5 [0006] Blackham et al., U.S. patent No. 5,978,142 discloses a system 
for projecting an image onto a screen. The system has first and second light 
modulators which both modulate light from a light source. Each of the light 
modulators modulates light from the source at the pixel level. Light 
modulated by both of the light modulators is projected onto the screen. 

10 

[0007] Gibbon et al., PCT application No. PCT/US01/21367 
discloses a projection system which includes a pre modulator. The pre 
modulator controls the amount of light incident on a deformable mirror 
display device. A separate pre-modulator may be used to darken a selected 
15 area (e.g. a quadrant). 

[0008] There exists a need for cost effective displays capable of 
reproducing a wide range of light intensities in displayed images. 

20 Summary of the Invention 

[0009] This invention provides displays for displaying images. One 
embodiment of the invention provides a display comprising: a light source 
comprising an array of light-emitting elements. Each of the elements has a 
controllable light output; and, a spatial light modulator comprising a 

25 plurality of controllable elements located to modulate light from the light 
source. A diffiiser directs light from the light source which has been 
modulated by the spatial light modulator to a viewing area. 
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[0010] Another aspect of the invention provides a display 
comprising: a spatial light modulator comprising an array of 

controllable elements, each of the controllable elements providing a 
5 controllable light transmission; a light source comprising an array of solid 
state light-emitting elements each located to illuminate a plurality of 
corresponding controllable elements of the spatial light modulator and each 
having a controllable light output; and, a diffuser. Brightness of a point on 
the diffuser may be controlled by controlling the light output of one of the 
10 light-emitting elements corresponding to the point and controlling the light 
transmission of one of the controllable elements corresponding to the point. 



[0011] A further aspect of the invention provides a display 
comprising: light provision means for providing light spatially 

15 modulated at a first spatial resolution; spatial modulation means for further 
spatially modulating the light at a second resolution different from the first 
resolution; and, means for controlling the first and second spatial 
modulation means to display an image defined by image data. 



20 [0012] The invention also provides a method for displaying an 
image. The method comprises controlling an array of individually- 
controllable light-emitting elements to have brightnesses determined by a 
first set of image data; illuminating a face of a spatial light modulator with 
light from the array of light-emitting elements, the spatial light modulator 

25 comprising an array of elements, each of the elements having a controllable 
transmissivity; and, controlling the transmissivity of the elements of the 
spatial light modulator with a second set of image data. 
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[0013] Further aspects of the invention and features of specific 
embodiments of the invention are described below. 

5 Brief Description of the Drawings 

[0014] In drawings which illustrate non-limiting embodiments of the 
invention, 

Figure 1 is a schematic illustration of a display according to one 
10 embodiment of the invention; 

Figure 1 A is a schematic illustration of a specific implementation of 
the display of Figure 1; 

Figure 2 is a schematic illustration of a display according to an 
alternative embodiment of the invention comprising four spatial light 
15 modulators; 

Figure 3 is a schematic illustration of a rear-projection-type display 
according to a further embodiment of the invention; 

Figure 4 is a schematic illustration of a front-projection-type display 
according to a still further embodiment of the invention; 
20 Figure 5 is a drawing illustrating a possible relationship between 

pixels in a higher-resolution spatial light modulator and pixels in a lower- 
resolution spatial light modulator in a display according to the invention; 

Figure 5 A illustrates an effect of providing one light modulator 
which has lower resolution than another light modulator; 
25 Figure 6 is a schematic illustration of a front-projection-type color 

display having an alternative projector construction; 
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Figures 6 A and 6B are expanded cross-sectional views of portions of 
the front-projection screen of the color display of Figure 6; 

Figure 7 is a graph illustrating how light imaged onto a higher- 
resolution light modulator from pixels of a lower-resolution light 
5 modulator can overlap to yield a smooth variation in light intensity with 
position; 

Figure 7A is a graph illustrating how the variation in light intensity 
with position for the image of a pixel of a light modulator can be 
represented as the convolution of a square profile and a spread function; 
10 Figure 8 is a schematic cross-section of a display according to an 

alternative embodiment of the invention and Figure 8A is a schematic front 
view thereof; 

Figure 8B is a schematic cross section of a display in which a spatial 
light modulator is spaced in front of an array of light sources; 
15 Figure 8C is a schematic view of a display having a grid interposed 

between an array of light sources and a spatial light modulator; 
Figure 8D is an isometric view of a hexagonal grid; 
Figure 8E is a schematic representation of one channel through a 
grid illustrating reflected and non-reflected light components impinging on 
20 a spatial light modulator; 

Figure 8F is a graph showing how reflected and non-reflected light 
components can sum to provide improved uniformity of illumination; 

Figure 8G is a schematic representation of a display wherein 
internally reflecting members which form a grid are formed integrally with 
25 the material encapsulating LEDs; 
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Figures 9A and 9B illustrate two possible configurations for an array 
of light emitting elements which could be used in the embodiment of 
Figure 8; 

Figure 9C illustrates the use of light barriers to provide increased 
5 sharpness; 

Figure 10 is a schematic illustration of a projection-type display 
according to an alternative embodiment of the invention; 

Figure 1 1 is a block diagram of a calibration mechanism; 

Figure 1 1 A is a depiction of an LED illustrating paths by which 
10 stray light exits the LED; and, 

Figures 1 IB, 1 1C, 1 ID and 1 IE are schematic diagrams of 
alternative calibration mechanisms. 

Description 

15 [0015] Throughout the following description, specific details are set 
forth in order to provide a more thorough understanding of the invention. 
However, the invention may be practiced without these particulars. In 
other instances, well known elements have not been shown or described in 
detail to avoid unnecessarily obscuring the invention. Accordingly, the 

20 specification and drawings are to be regarded in an illustrative, rather than 
a restrictive, sense. 

[0016] This invention provides displays capable of rendering images 
with high dynamic ranges. Displays according to the invention comprise 
25 two light modulating stages. Light passes through the stages in series to 
provide an image which has an increased dynamic range. 
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[0017] Figure 1 illustrates schematically a display 10 according to a 
simple embodiment of the invention. The sizes of elements and distances 
between them in Figure 1 are not to scale. Display 10 comprises a light 
source 12. Light source 12 may, for example, comprise a projection lamp 
5 such as an incandescent lamp or an arc lamp, a laser, or another suitable 
source of light. Light source 12 may comprise an optical system 
comprising one or more mirrors, lenses or other optical elements which 
cooperate to deliver light to the rest of display 10. 



10 [0018] In the illustrated embodiment, light from light source 12 is 
directed toward a first light modulator 16. Light source 12 preferably 
provides substantially uniform illumination of first light modulator 16. 
Light modulator 16 comprises an array of individually addressable 
elements. Light modulator 16 may comprise, for example, a LCD (liquid 

1 5 crystal display), which is an example of a transmission-type light 

modulator or a DMD (deformable mirror device), which is an example of a 
reflection-type light modulator. Display driver circuitry (not shown in 
Figure 1) controls the elements of light modulator 16 according to data 
which defines an image being displayed. 

20 

[0019] Light which has been modulated by first light modulator 16 is 
imaged onto a rear-projection screen 23 by a suitable optical system 17. 
Light from a small area of first light modulator 16 is directed by optical 
system 17 to a corresponding area on rear-projection screen 23. In the 
25 illustrated embodiment, optical system 17 comprises a lens having a focal 
length / In general, the optical system 17 which images light modulated by 
first light modulator 16 onto rear-projection screen 23 may comprise one or 
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more mirrors, lenses or other optical elements. Such an optical system has 
the function of imaging light modulated by the first light modulator onto a 
second light modulator. Optical system 17 may be termed an imaging 
means. 

5 

[0020] In the illustrated embodiment, rear-projection screen 23 
comprises a second light modulator 20 and a collimator 18. A main 
function of collimator 18 is to cause light which passes through rear- 
projection screen 23 to be directed preferentially toward a viewing area. 
10 Collimator 18 may comprise a Fresnel lens, a holographic lens, or, in the 
alternative, another arrangement of one or more lenses and/or other optical 
elements which operate to guide light in the direction of a viewing area. 

[0021] In the illustrated embodiment, collimator 18 causes light to 
1 5 travel through the elements of second light modulator 20 in a direction 
which is generally normal to screen 23. As light incident from collimator 
18 travels through second light modulator 20 it is further modulated. The 
light then passes to a diffuser 22 which scatters the outgoing light through 
a range of directions so that a viewer located on an opposite side of 
20 diffuser 22 from first light modulator 16 can see light originating from the 
whole area of screen 23. In general, diffuser 22 may scatter light to a 
different angular extent in the horizontal and vertical planes. Diffuser 22 
should be selected so that light modulated by second light modulator 20 is 
scattered through a range of angles such that the maximum scatter angle is 
25 at least equal to the angle subtended by screen 23 when viewed from a 
desired viewing location. 
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[0022] Rear-projection screen 23 may differ in area from first light 
modulator 16. For example, rear-projection screen 23 may be larger in area 
than first light modulator 16. Where mis is the case, optical system 17 
expands the beam of light modulated by first light modulator 16 to 
5 illuminate a corresponding area on rear-projection screen 23 which is 
larger than first light modulator 16. 

[0023] Second light modulator 20 may be of the same type as first 
light modulator 16 or a different type. Where first and second light 
10 modulators 16 and 20 are both of types that polarize light, second light 
modulator 20 should, as much as is practical, be oriented so that its plane 
of polarization matches that of the light incident on it from first light 
modulator 16. 



1 5 [0024] Display 10 may be a color display. This may be achieved in 
various ways including: 

making one of first light modulator 16 and second light modulator 
20 a color light modulator; 

providing a plurality of different first light modulators 16 operating 
20 in parallel on different colors; and, 

• providing a mechanism for rapidly introducing different color filters 

into the light path ahead of second light modulator 20. 
As an example of the first approach above, second light modulator 20 may 
comprise an LCD panel having a plurality of pixels each comprising a 
25 number of colored sub-pixels. For example, each pixel may comprise three 
sub-pixels, one associated with a red filter, one associated with a green 
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filter and one associated with a blue filter. The filters may be integral with 
the LCD panel. 



[0025] As shown in Figure 1 A, Light source 12, first light modulator 
5 16 and optical system 17 may all be parts of a digital video projector 37 
located to project an image defined by a signal 38 A from a controller 39 
onto the back side of rear-projection screen 23. The elements of second 
light modulator 20 are controlled by a signal 38B from controller 39 to 
provide an image to a viewer which has a high dynamic range. 

10 

[0026] Controller 39 may comprise any suitable data processor. 
Controller 39 may comprise one or more microprocessors running suitable 
control software together with interfaces which permit controller 39 to 
control the operation of a display according to the invention. The general 
15 construction of such controllers and general techniques for programming 
such controllers to provide desired functions are well known to those 
skilled in the art and will not be described in detail herein. 



[0027] As shown in Figure 2, a display 10A according to the 
20 invention may comprise one or more additional light modulation stages 24. 
Each additional light modulation stage 24 comprises a collimator 25, a 
light modulator 26 and an optical system 27 which focuses light from light 
modulator 26 onto either the next additional light modulation stage 24 or 
on collimator 18. In device 10A of Figure 2 there are two additional light 
25 modulation stages 24. Devices according to this embodiment of the 
invention may have one or more additional light modulation stages 24. 



L 
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[0028] The luminance of any point on output diffuser 22 can be 
adjusted by controlling the amount of light passed on by corresponding 
elements of light modulators 16, 20 and 26. This control may be provided 
by a suitable control system (not shown in Figure 2) connected to drive 
5 each of light modulators 16, 20 and 26. 

[0029] As noted above, light modulators 16, 20 and 26 may all be of 
the same type or may be of two or more different types. Figure 3 illustrates 
a display 10B according to an alternative embodiment of the invention 

1 0 which includes a first light modulator 16A which comprises a deformable 
mirror device. A deformable mirror device is a "binary" device in the sense 
that each pixel may be either "on" or "off". Different apparent brightness 
levels may be produced by turning a pixel on and off rapidly. Such devices 
are described, for example, in U.S. patent Nos. 4,441,791 and, 4,954,789 

1 5 and are commonly used in digital video projectors. Light source 12 and 
first light modulator 16 (or 16A) may be the light source and modulator 
from a commercial digital video projector, for example. 

[0030] Figure 4 illustrates a front-projection-type display 10C 
20 according to the invention. Display 10C comprises a screen 34. A projector 
37 projects an image 38 onto screen 34. Projector 37 comprises a suitable 
light source 12, a first light modulator 16 and an optical system 17 suitable 
for projecting an image defined by first light modulator 16 onto screen 34. 
Projector 37 may comprise a commercially available display projector. 
25 Screen 34 incorporates a second light modulator 36. Second light 

modulator 36 comprises a number of addressable elements which can be 
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individually controlled to affect the luminance of a corresponding area of 
screen 34. 

[0031] Light modulator 36 may have any of various constructions. 
5 For example, light modulator 36 may comprise an array of LCD elements 
each having a controllable transmissivity located in front of a reflective 
backing. Light projected by projector 37 passes through each LCD element 
and is reflected back through the LCD element by the reflective backing. 
The luminance at any point on screen 34 is determined by the intensity of 
1 0 light received at that point by projector 37 and the degree to which light 
modulator 36 (e.g. the LCD element at that point) absorbs light being 
transmitted through it. 

[0032] Light modulator 36 could also comprise an array of elements 
1 5 having variable retro-reflection properties. The elements may be prismatic. 
Such elements are described, for example, in Whitehead, U.S. patent No. 
5,959,777 entitled Passive High Efficiency Variable Reflectivity Image 
Display Device and, Whitehead et al., U.S. patent No. 6,215,920 entitled 
Electrophoretic, High Index and Phase Transition Control of Total Internal 
20 Reflection in High Efficiency Variable Reflectivity Image Displays. 

[0033] Light modulator 36 could also comprise an array of 
electrophoretic display elements as described, for example, in Albert et al., 
U.S. patent No. 6,172,798 entitled Shutter Mode Microencapsulated 
25 Electrophoretic Display; Comiskey et al., U.S. patent No. 6,120,839 
entitled Electro-osmotic Displays and Materials for Making the Same; 
Jacobson, U.S. patent No. 6,120,588 entitled: Electronically Addressable 
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Microencapsulated Ink and Display; Jacobson et al., U.S. patent No. 
6,323,989 entitled Electrophoretic Displays Using Nanoparticles; Albert, 
U.S. patent No. 6,300,932 entitled Electrophoretic Displays with 
Luminescent Particles and Materials for Making the Same or, Comiskey et 
5 al., U.S. patent No. 6,327,072 entitled Microcell Electrophoretic Displays. 

[0034] As shown in Figures 6A and 6B, screen 34 preferably 
comprises a lens element 40 which functions to direct light preferentially 
toward the eyes of viewers. In the illustrated embodiment, lens element 40 

10 comprises a Fresnel lens having a focal point substantially coincident with 
the apex of the cone of light originating from projector 37. Lens element 
40 could comprise another kind of lens such as a holographic lens. Lens 
element 40 incorporates scattering centers 45 which provide a desired 
degree of diffusion in the light reflected from screen 34. In the illustrated 

1 5 embodiment, second light modulator 36 comprises a reflective LCD panel 
having a large number of pixels 42 backed by a reflective layer 43 and 
mounted on a backing 47. 

[0035] Where light modulator 36 comprises an array of elements 
20 having variable retro-reflection properties, the elements themselves could 
be designed to direct retro-reflected light preferentially in a direction of a 
viewing area in front of screen 34. Reflective layer 43 may be patterned to 
scatter light to either augment the effect of scattering centers 45 or replace 
scattering centers 45. 

25 

[0036] As shown in Figure 4, a controller 39 provides data defining 
image 38 to each of first light modulator 16 and second light modulator 36. 
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Controller 39 could comprise, for example, a computer equipped with a 
suitable display adapter. The luminance of any point on screen 34 is 
determined by the combined effect of the pixels in first light modulator 16 
and second light modulator 36 which correspond to that point. There is 
5 minimum luminance at points for which corresponding pixels of the first 
and second light modulators are set to their "darkest" states. There is 
maximum luminance at points for which corresponding pixels of the first 
and second light modulators are set to their "brightest" states. Other points 
have intermediate luminance values. The maximum luminance value might 
10 be, for example, on the order of 10 s cd/m 2 . The minimum luminance value 
might be, for example on the order of 10' 2 cd/m 2 . 

[0037] The cost of a light modulator and its associated control 
circuitry tends to increase with the number of addressable elements in the 

15 light modulator. In some embodiments of the invention one of the light 
modulators has a spatial resolution significantly higher than that of one or 
more other ones of the light modulators. When one or more of the light 
modulators are lower-resolution devices the cost of a display according to 
such embodiments of the invention may be reduced. In color displays 

20 comprising two or more light modulators, one of which is a color light 
modulator (a combination of a plurality of monochrome light modulators 
may constitute a color light modulator as shown, for example, in Figure 6) 
and one of which is a higher-resolution light modulator, the higher- 
resolution light modulator should also be the color light modulator. In 

25 some embodiments the higher- resolution light modulator is imaged onto 
the lower-resolution light modulator. In other embodiments the lower- 
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resolution light modulator is imaged onto the higher-resolution light 
modulator. 

[0038] Figure 5 illustrates one possible configuration of pixels in a 
5 display 10 as shown in Figure 1. Nine pixels 42 of a second light 

modulator 20 correspond to each pixel 44 of a first light modulator 16. The 
number of pixels 42 of second light modulator 20 which correspond to 
each pixel 44 of first light modulator 16 may be varied as a matter of 
design choice. Pixels 44 of the higher-resolution one of first and second 

1 0 light modulators 16 and 20 (or 36) should be small enough to provide a 

desired overall resolution. In general there is a trade off between increasing 
resolution and increasing cost. In a typical display the higher-resolution 
light modulator will provide an array of pixels having at least a few 
hundred pixels in each direction and more typically over 1000 pixels in 

15 each direction. 

[0039] The size of pixels 42 of the lower-resolution one of the first 
and second light modulators determines the scale over which one can 
reliably go from maximum intensity to minimum intensity. Consider, for 

20 example, Figure 5A which depicts a situation where one wishes to display 
an image of a small maximum-luminance spot on a large minimum- 
luminance background. To obtain maximum luminance in a spot 47, those 
pixels of each of the first and second light modulators which correspond to 
spot 47 should be set to their maximum-luminance values. Where the 

25 pixels of one light modulator are lower in resolution than pixels of the 
other light modulator then some pixels of the lower-resolution light 
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modulator will straddle the boundary of spot 47. This is the case, for 
example, in Figure 5A. 

[0040] Outside of spot 47 there are two regions. In region 48 it is not 
5 possible to set the luminance to its minimum value because in that region 
the lower-resolution light modulator is set to its highest luminance value. 
In region 49 both of the light modulators can be set to their lowest- 
luminance values. If, for example, each of the first and second light 
modulators has a luminance range of 1 to 100 units, then region 47 might 
1 0 have a luminance of 1 00 x 1 00=1 0,000 units, region 48 would have a 

luminance of 100x1=100 units and region 49 would have a luminance of 
1x1=1 units. 

[0041] As a result of having one of the light modulators lower in 
15 resolution than the other, each pixel of the lower-resolution light modulator 
corresponds to more than one pixel in the higher-resolution light 
modulator. It is not possible for points corresponding to any one pixel of 
the lower-resolution light modulator and different pixels of the higher- 
resolution light modulator to have luminance values at extremes of the 
20 device's dynamic range. The maximum difference in luminance between 
such points is determined by the dynamic range provided by the higher- 
resolution light modulator. 

[0042] It is generally not a problem that a display is not capable of 
25 causing closely-spaced points to differ in luminance from one another by 
the full dynamic range of the display. The human eye has enough intrinsic 
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scatter that it is incapable of appreciating large changes in luminance 
which occur over very short distances in any event. 

[0043] In a display according to the invention which includes both a 
5 lower-resolution spatial light modulator and a higher-resolution spatial 
light modulator, controller 39 may determine a value for each pixel of the 
lower-resolution spatial light modulator and adjust the signals which 
control the higher-resolution spatial light modulator to reduce artefacts 
which result from the fact that each pixel of the lower-resolution spatial 
10 light modulator is common to a plurality of pixels of the higher-resolution 
spatial light modulator. This may be done in any of a wide number of 
ways. 

[0044] To take but one example, consider the case where each pixel 
15 of the lower-resolution spatial light modulator corresponds to a plurality of 
pixels of the higher-resolution spatial light modulator. Image data 
specifying a desired image is supplied to the controller. The image data 
indicates a desired luminance for an image area corresponding to each of 
the pixels of the higher-resolution spatial light modulator. The controller 
20 may set the pixels of the lower-resolution light modulator to provide an 
approximation of the desired image. This could be accomplished, for 
example, by determining an average or weighted average of the desired 
luminance values for the image areas corresponding to each pixel of the 
lower-resolution display. 

25 

[0045] The controller may then set the pixels of the higher- 

resolution display to cause the resulting image to approach the desired 
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image. This could be done, for example, by dividing the desired luminance 
values by the intensity of light incident from the lower-resolution light 
modulator on the corresponding pixels of the higher-resolution light 
modulator. The intensity of light incident from the lower-resolution light 
5 modulator on a pixel of the higher-resolution light modulator can be 
computed from the known way that light from each pixel of the lower 
resolution spatial light modulator is distributed on the higher resolution 
spatial light modulator. The contributions from one or more of the pixels of 
the lower resolution spatial light modulator can be summed to determine 
1 0 the intensity with which any pixel of the higher resolution spatial light 
modulator will be illuminated for the way in which the pixels of the lower 
resolution spatial light modulator are set. 

[0046] If the low-resolution pixels are too large then a viewer may be 
able to discern a halo around bright elements in an image. The low 
resolution pixels are preferably small enough that the appearance of bright 
patches on dark backgrounds or of dark spots on bright backgrounds is not 
unacceptably degraded. It is currently considered practical to provide in the 
range of about 8 to about 144, more preferably about 9 to 36, pixels on the 
higher-resolution light modulator for each pixel of the lower-resolution 
light modulator. 

[0047] The sizes of steps in which each of pixels 42 and 44 can 
adjust the luminance of point(s) on the image are not necessarily equal. 
25 The pixels of the lower-resolution light modulator may adjust light 
intensity in coarser steps than the pixels of the higher-resolution light 
modulator. For example, the lower-resolution light modulator may permit 



15 



20 
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adjustment of light intensity for each pixel over an intensity range of 1 to 
512 units in 8 steps while the higher-resolution light modulator may permit 
adjustment of the light intensity for each pixel over a similar range in 5 12 
steps. While pixels 42 and 44 are both illustrated as being square in Figure 
5 5, this is not necessary. Pixels 42 and/or 44 could be other shapes, such as 
rectangular, triangular, hexagonal, round, or oval. 



[0048] The pixels of the lower-resolution light modulator preferably 
emit light which is somewhat diffuse so that the light intensity varies 

1 0 reasonably smoothly as one traverses pixels of the lower-resolution light 
modulator. This is the case where the light from each of the pixels of the 
lower-resolution light modulator spreads into adjacent pixels, as shown in 
Figure 7. As shown in Figure 7A, the intensity profile of a pixel in the 
lower-resolution light modulator can often be approximated by gaussian 

1 5 spread function convolved with a rectangular profile having a width dj 

equal to the active width of the pixel. The spread function preferably has a 
full width at half maximum in the range of 0.3 x^ 2 to 3*d 2 , where d 2 is the 
center-to-center inter-pixel spacing, to yield the desired smoothly varying 
light intensity. Typically d t is nearly equal to d 2 . 

20 

[0049] In the embodiment of Figure 5, each pixel 42 comprises three 
sub pixels 43R , 43G and 43B (for clarity Figure 5 omits sub pixels for 
some pixels 42). Sub-pixels 43R , 43G and 43B are independently 
addressable. They are respectively associated with red, green and blue 
25 color filters which are integrated into second light modulator 20. Various 
constructions of LCD panels which include a number of colored sub-pixels 
and are suitable for use in this invention are known in the art. 
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[0050] For front projection-type displays (for example the display 
10C of Figure 4), it is typically most practical for first light modulator 16 
to comprise a high-resolution light modulator which provides color 
5 information and for light modulator 36 to comprise a monochrome light 
modulator. Light modulator 36 preferably has reasonably small addressable 
elements so that the boundaries of its elements do not form a visually 
distracting pattern. For example, light modulator 36 may have the same 
number of addressable elements as projector 37 (although each such 
1 0 element will typically have significantly larger dimensions than the 
corresponding element in light modulator 16 of projector 37). 

[0051] Projector 37 may have any suitable construction. All that is 
required is that projector 37 be able to project light which has been 

1 5 spatially modulated to provide an image onto screen 34. Figure 6 illustrates 
a display system 10D according to a further alternative embodiment of the 
invention. System 10D comprises a screen 34 which has an integrated light 
modulator 36 as described above with reference to Figure 4. System 10D 
comprises a projector 37A which has separate light modulators 16R, 16G 

20 and 16R for each of three colors. Light modulated by each of light 

modulators 16R, 16G and 16R is filtered by a corresponding one of three 
colored filters 47R, 47G and 47B. The modulated light is projected onto 
screen 34 by optical systems 17. A single light source 12 may supply light 
to all three light modulators 16R, 16G, and 16B, or separate light sources 

25 (not shown) may be provided. 
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[0052] In the embodiments described above, light from a light source 
is spatially modulated by a first light modulator and then imaged onto a 
second light modulator. The inventors have realized that the functions of 
the light source and first light modulator can be combined by providing a 
5 light source comprising an array of light-emitting elements which each 
have a controllable brightness. The light-emitting elements may be solid 
state devices. For example, the light-emitting elements may comprise light- 
emitting diodes (LEDs). Each of the LEDs may be driven by a driver 
circuit which allows the current flowing through the LED, and 

1 0 consequently the brightness of the light emitted by the LED, to be 

controlled. The controller may also, or in the alternative, control a duty 
cycle of the corresponding LED. As discussed below, the driving circuit 
may monitor current being delivered to each LED or each group of LEDs 
and may generate an error signal if the magnitude of the current being 

1 5 delivered to each LED or each group of LEDs has an unexpected value. 
Such error signals may be used by a controller to compensate for failed 
LEDs. 

[0053] In a preferred embodiment of the invention, the LEDs are of a 
20 type which emit white light. For example, the LEDs may comprise an array 
of tri-color LEDs. Tri-color LEDs which each include red, green and blue 
LEDs all encapsulated within a single housing are commercially available. 
One or more white LEDs may be used to illuminate each group of pixels of 
the second light modulator. 

25 

[0054] Figure 8 shows a section through a display 60 according to an 
embodiment of the invention in which a rear-projection screen 53 
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comprising a diffusing layer 22 is illuminated by an array 50 of LEDs 52. 
The brightness of each LED 52 is controlled by a controller 39. Screen 53 
includes a light modulator 20. The rear face of light modulator 20 is 
illuminated by LED array 50. Figure 8A is a schematic front view of a 
5 portion of display 60 for a case where controllable elements (pixels) 42 of 
light modulator 20 correspond to each LED 52. Each of the controllable 
elements 42 may comprise a plurality of colored sub-pixels. 



[0055] LEDs 52 may be arranged in any suitable manner in array 50. 

1 0 Two likely arrangements of LEDs 52 are shown in Figures 9A and 9B. 

Figure 9A illustrates a rectangular array 50A of light sources 51. Figure 9B 
illustrates a hexagonal array 50B of light sources 51. Light sources 51 may 
comprise LEDs 52. Where light sources 51 comprise discrete devices, a 
regular spacing between light sources 51 may be maintained by packing 

1 5 light sources 51 together as illustrated in Figure 9A or 9B, for example. 

[0056] A diffuser 22A in conjunction with the light-emitting 
characteristics of LEDs 52 causes the variation in intensity of light from 
LEDs 52 over the rear face of light modulator 20 to be smooth. 

20 

[0057] A similar effect can be obtained without a diffuser 22A by 
spacing light modulator 20 away from LEDs 52. Where light modulator 20 
is spaced away from LEDs 52, light from each LED 52 can contribute to 
illuminating edges of the areas of spatial light modulator 20 corresponding 
25 to neighboring LEDs 52. 
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[0058] In cases where it is necessary that the display be viewable 
through a large range of angles, such spacing can cause a parallax problem. 
Where a viewer is not viewing a display head-on, as shown in Figure 8B, 
the viewer may see a pixel of spatial light modulator 20 illuminated by an 
5 LED 52 which does not correspond to the pixel. For example, in Figure 
8B, area 21A corresponds to LED 52A and area 21B corresponds to LED 
52B. However, due to parallax, the viewer sees pixels in area 21 A as being 
illuminated by LED 52B. 

10 [00591 Figure 8C shows an alternative construction which avoids the 
parallax problem illustrated by Figure 8B. In Figure 8C, a grid 122 of 
reflective-walled channels 123 is disposed between array 50 and spatial 
light modulator 20. In a preferred embodiment, channels 123 are hexagonal 
in cross section and grid 122 comprises a honeycomb structure as shown in 

15 Figure 8D. Channels 123 could also have other cross sectional shapes such 
as square, triangular, rectangular or the like. The walls which define 
channels 123 are preferably thin. Grid 122 could comprise, for example, a 
section of aluminum honeycomb material. 



20 [0060] Channels 123 may be, but are not necessarily hollow. 

Channels 123 may be provided by columns of light-transmitting material 
having walls at which light is internally reflected, preferably totally 
internally reflected. The columns may be separated by thin air gaps or clad 
in one or more materials which provide an interface at which light is 

25 internally reflected. The columns may be integral with the material in 

which LEDs 52 are encapsulated. Figure 8G shows an embodiment of the 
invention in which columns 123 A having internally reflecting walls are 
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integrally formed with LEDs 52C. Columns 123A may have various cross 
sectional shapes such as hexagonal, triangular, square or the like. 

[0061] Light from each LED 52 passes through a channel 123. As 
shown in Figure 8E, some light from an LED passes straight through 
channel 123 and some light is reflected from reflective walls 124 of 
channel 123. The luminance at a point on spatial light modulator 20 is 
contributed to by both reflected and non-reflected light. The reflected 
component tends to be more intense around the edges of channel 123 while 
the non-reflected component tends to be more intense toward the center of 
channel 123. The result is that the uniformity with which each LED 52 
illuminates the corresponding portion of spatial light modulator 20 is 
improved by the presence of grid 122. The increase in uniformity is 
illustrated in Figure 8F. 

[0062] Grid 122 is spaced slightly away from spatial light modulator 
20 by a gap 57 (see Figs. 8C and 8E) to avoid perceptible shadows cast by 
the walls which separate adjacent channels 123 of grid 122. 

[0063] The geometry of channels 123 may be varied to achieve 
design goals. The width of each channel 123 largely detennines the 
resolution with which the intensity of light falling on spatial light 
modulator 20 can be varied. For a given channel width and cross sectional 
shape, the uniformity of illumination provided by each channel 123 can be 
increased by making the channel 123 longer. This, however, reduces the 
efficiency with which light is passed to spatial light modulator 20. 
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[0064] A reasonable trade off between efficiency and uniformity of 
illumination may be achieved by providing channels 123 which have 
lengths L such that near the channel edges non-reflected and once-reflected 
light components are each approximately half of the intensity of the non- 
5 reflected component on the axis of LED 52. One way to approximately 
achieve this is to choose length L such that the angle 0 between the axis of 
LED 52 and the edge of channel 123 is equal to the half angle 0 1/4 of the 
LED 52. The half angle is the angle at which the illumination provided by 
LED 52 has an intensity equal to one half of the intensity of illumination in 
1 0 a forward direction on the axis of LED 52. This condition is provided by 
making L satisfy the condition of equation (1), where R is the half- width of 
channel 123. 

[0065] It is generally desirable to provide one channel 123 for each 
15 LED or other light source. In some embodiments of the invention each 
channel 123 has a plurality of LEDs. In one embodiment of the invention 
each channel 123 has three LEDs of different colors, for example, red, 
green and blue. In such embodiments it is important that the channel 123 
be long enough that light from each of the LEDs be uniformly distributed 
20 at spatial light modulator 20 as the human eye is sensitive to variations in 
color. 



25 



[0066] As described above, with reference to Figures 7 and 7 A, light 
modulator 20 is preferably illuminated in a manner such that the 
illumination of light modulator 20 by LED array 50 changes smoothly with 
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position on light modulator 20. This can be accomplished by providing 
LEDs 52 in LED array 50 which emit light in patterns which overlap 
somewhat on light modulator 20. The light emitted by each LED 52 may 
be characterized by a spread function such that the variation of the 
5 intensity of light from an LED 52 incident on light modulator 20 is the 
convolution of a rectangular profile and the spread function. The spread 
function preferably has a full width at half maximum in the range of 0.3^d 2 
to 3*d 2 , where d 2 is the center-to-center spacing on light modulator 20 
between the illumination patterns of adjacent LEDs 52 on light modulator 
10 20. A diffuser 22 A (shown in dashed lines Figure 8) may be interposed 
between array 50 and light modulator 20 to broaden the illumination 
patterns of LEDs 52 on light modulator 20. 

[0067] For some applications it may be desirable to provide a display 
15 on which the level of illumination of closely spaced pixels may be greatly 
different. This may be achieved, at the cost of some smoothness, by 
confining light originating from each of the light sources of array 50 so that 
the illumination patterns of adjacent light sources on light modulator 20 do 
not overlap significantly. This may be achieved, for example, by providing 
20 light barriers 56 which limit the spread of light from each of the light 
sources of array 50 as shown in Figure 9C. With light barriers 56, each 
light source of array 50 illuminates only corresponding pixels of light 
modulator 20. This may also be achieved by providing light sources 52 
which project substantially non-overlapping illumination patterns onto 
25 light modulator 20. In either case, the resulting image displayed to a viewer 
may appear somewhat sharper than in embodiments wherein light from 
each light source 52 is permitted to spread sufficiently that it provides 
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significant illumination to some pixels corresponding to adjacent light 
sources. In many cases, limitations of the human eye will make this 
increased level of sharpness unnoticeable. 

5 [0068] Light modulator 20 may be a monochrome light modulator. In 
the alternative, light modulator 20 may be a high resolution color light 
modulator. Light modulator 20 may comprise, for example, a LCD array. 
Display 60 can be quite thin. For example, display 60 may be 10 
centimeters or less in thickness. 

10 

[0069] Figure 10 shows a projection-type display 70 which is similar 
to display 60 of Figure 8 except that an array 50 of light sources 52 is 
imaged onto a light modulator 20 by a suitable optical system 17. 

1 5 [0070] A controller 39 may control the elements of array 50 to 
provide a low-resolution version of an image to be displayed on spatial 
light modulator 20. Controller 39 may control the elements of spatial light 
modulator 20 to supply features having a high spatial resolution and to 
otherwise correct the image provided by array 50 as described above. 

20 

[0071] One problem with using LEDs 52 as light sources in a high 
resolution high quality display is that the brightness of light emitted at a 
specific current level can vary significantly between individual LEDs. This 
variation is due to manufacturing process variations. Further, the brightness 
25 of light that a LED 52 will produce tends to slowly decrease in an 

unpredictable manner as the LED ages. It is therefore desirable to provide 
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a mechanism for calibrating an LED array 50 to compensate for differences 
in brightness between different LEDs 52 in array 50. 



[0072] One calibration mechanism 78 which is illustrated 
5 schematically in Figure 1 1 provides a light detector 80 which detects light 
emitted by each of LEDs 52. Light detector 80 may be moved into different 
positions for capturing light from different LEDs 52. In the alternative, a 
suitable optical system may be provided to direct light from LEDs 52 to 
light detector 80. Controller 39 receives a signal 81 from light detector 80. 

10 Signal 81 indicates the brightness of light emitted by each LED 52 in array 
50 for a given current. If the brightness of light emitted by an LED 52 
differs from a desired value then controller 39 determines a correction to be 
applied to the current applied to each LED 52. Controller 39 subsequently 
applies the correction. Calibration mechanism 78 may be used for initial 

15 calibration of a display. Calibration mechanism 78 may optionally include 
a calibration controller 39A which performs some calibration tasks, such 
as determining a correction to be applied to the current applied to each 
LED 52, and making the resulting calibration information available to 
controller 39. 

20 

[0073] It is desirable to provide a calibration mechanism that does 
not interfere with the normal operation of a display. One way to achieve 
this is to detect light which is emitted by an LED in a direction other than 
the forward direction. Figure 1 1 A shows a typical LED 52. Most light 
25 emitted by LED 52 is directed in a forward direction as shown by arrow 
55A. A very small fraction of the light emitted by each LED 52 is emitted 
sideways as indicated by arrows 55B or rearwardly as indicated by arrow 
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55C. Light emitted in a direction other than the forward direction may be 
termed "stray light". One or more light detectors 80A may be located to 
detect stray light from each LED 52. 

5 [0074] A calibration mechanism 90 according to one embodiment of 
the invention is shown in Figure 1 IB. In calibration mechanism 90, small 
optical waveguides 82 carry stray light from LEDs 52 to a light detector 
80. Only a small fraction of the light emitted by each LED 52 is captured 
by waveguides 82. As long as the coupling between a waveguide 82 and 
1 0 the corresponding LED 52 does not change, the proportion of the light 
emitted by an LED 52 which is captured by waveguide 82 remains 
constant. One light detector 80A or a few light detectors80A may be 
located at convenient locations such as at edges of array 50. 

1 5 [00751 Figure 1 1 C shows a calibration mechanism 90A according to 
another embodiment of the invention. In mechanism 90A, individual 
optical waveguides 82 are replaced by a planar optical waveguide 82A. 
Power leads for LEDs 52 pass through holes 83 in waveguide 82A. One or 
more light detectors 80A are located at edges of optical waveguide 82A. 

20 Light emitted in the rearward direction by any of LEDs 52 is trapped 
within optical waveguide 82A and detected by light detector(s) 80A. 

[0076] Figure 1 ID shows another optical calibration mechanism 90B 
wherein a planar optical waveguide 82B collects light emitted by LEDs 52 
25 in sideways directions and carries that light to one or more light detectors 
80A. 
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[0077] Figure 1 IE shows another optical calibration mechanism 90C 
wherein a planar optical waveguide 82C collects a small fraction of the 
light emitted by LEDs 52 in the forward direction and carries that light to 
one or more light detectors 80A. Waveguide 82C is constructed so that 
5 some light passing through it in the forward direction is trapped in 

waveguide 82C and carried to light detector(s) 80A. To achieve this, one 
surface of waveguide 82C, typically the surface facing LEDs 52 may be 
roughened slightly to scatter some light generally into the plane of 
waveguide 82C or some scattering centers may be provided in the material 
10 of waveguide 82C. In the illustrated embodiment, waveguide 82C acts as a 
spacer which maintains a gap 57 between a grid 122 and spatial light 
modulator 20. Calibration mechanism 80C has the advantage that optical 
waveguide 82C does not need to be penetrated by holes 83 which can 
interfere with the propagation of light to light detector(s) 80A. 

15 

[0078] In operation, an array 50 is first factory calibrated, for 
example, with a calibration mechanism 78 (Fig 11). After, or during, 
factory calibration LEDs 52 are turned on one at a time with current at a 
calibration level. Light detector(s) 80A are used to measure stray light for 

20 each LED 52. Information about the amount of stray light detected for each 
LED 52 may be stored as a reference value. Over the life of LED array 50, 
mechanism 90 can be used to monitor the brightness of each LED 52. 
Depending upon the application, such brightness measurements may be 
made at times when the display is initialized or periodically while the 

25 display is in use. Brightness measurements of one or more LEDs 52 may 
be made in intervals between the display of successive image frames. 
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[0079] If mechanism 90 detects that the brightness of an LED 52 has 
changed over time (typically as indicated by a decrease in the amount of 
stray light detected by light detector(s) 80A in comparison to the stored 
reference value) then controller 39 can automatically adjust the current 
5 provided to that LED 52 to compensate for its change in brightness. 



[0080] A calibration mechanism 90 can also be used to detect failures 
of LEDs 52. Although LEDs 52 tend to be highly reliable they can fail. 
Calibration mechanism 90 can detect failure of an LED 52 by detecting no 

1 0 light from LED 52 when controller 39 is controlling LED 52 to be "ON". 
Certain failure modes of an LED 52 or a row of LEDs 52 may also be 
detected by LED driving electronics associated with controller 39. If the 
driving electronics detect that no current, or a current having an 
unexpected value, is being delivered at a time when current should be 

1 5 passing through one or more LEDs 50 then the driving electronics may 
generate an error signal detectable by controller 39. 

[0081] Where controller 39 detects a failure of one or more LEDs 52, 
controller 39 may compensate for the failure(s) by increasing brightness of 

20 one or more neighboring LEDs 52, adjusting the elements of spatial light 
modulator 20 which correspond to the failed LED 52 to provide greater 
light transmission, or both. In fault tolerant displays according to this 
embodiment of the invention, after failure of an LED 52, spill over light 
from adjacent LEDs 52 illuminates the area corresponding to the failed 

25 LED 52 sufficiently to make the image visible in the area. 
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[0082] Where controller 39 is configured to increase the brightness 
of neighboring LEDs 52, controller 39 may determine the amount of 
increase based in part upon the image content of the area of spatial light 
modulator 20 corresponding to the failed LED. If the image content calls 
5 for the area to be bright then the brightness of neighboring LEDs may be 
increased more than if the image content calls for the area to be dark. The 
resulting image quality will be degraded but catastrophic failure will be 
avoided. 



10 [0083] In some embodiments of the invention each LED 52 is 

dimmed or turned off during those times when the corresponding elements 
of spatial light modulator are being refreshed. Some spatial light 
modulators refresh slowly enough that the refresh can be perceived by a 
viewer. This causes an undesirable effect called "motion blur". 

15 

[0084] With proper timing, at those times when each row of spatial 
light modulator 20 is being refreshed, corresponding LEDs 52 can be off or 
dimmed. At other times the corresponding LEDs 52 can be overdriven 
sufficiently that a viewer perceives a desired brightness. The viewer's eye 
20 cannot perceive rapid flickering of LEDs 52. Instead, the viewer perceives 
an average brightness. It is typically desirable to multiplex the operation of 
LEDs 52. Where LEDs are operated in a multiplexed manner, correcting 
for motion blur can be performed by synchronizing the multiplexing of 
LEDs 52 with the refreshing of spatial light modulator 52. 

25 

[0085] As will be apparent to those skilled in the art in the light of 
the foregoing disclosure, many alterations and modifications are possible in 



WO 03/077013 PCT/CA03/00350 

-33- 

the practice of this invention without departing from the spirit or scope 
thereof. For example: 

diffuser 22 and collimator 18 could be combined with one another; 

diffuser 22 and collimator 18 could be reversed in order; 
5 • multiple cooperating elements could be provided to perform light 

diffusion and/or collimation; 

the function of diffuser 22 could be provided by another element 
which both diffuses light and performs some other function. In such 
cases, the other element may be said to comprise a diffuser and an 
10 apparatus comprising such an element comprises a diffuser; 

the order in screen 23 of second light modulator 20 collimator 18 
and diffuser 22 could be varied; 

the signal 38A driving first light modulator 16 may comprise the 
same data driving second light modulator 20 or may comprise 
1 5 different data. 

• Instead of or in addition to providing measuring light output for 
fixed calibration currents, calibration mechanisms 78 and/or 90 
could adjust current to a LED 52 until the LED 52 provides a 
desired brightness. 

20 Accordingly, the scope of the invention includes, but is not limited to, the 
substance defined by the following claims. 



